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Using generating function methods for diagonalizing the transition matrix in 2-Urn models, we 
provide a complete classification into solvable and unsolvable subclasses, with further division of 
the solvable models into the Martingale and non-Martingale subcategories, and prove that the 
stationary distribution is a Gaussian function in the latter. We also give a natural condition related 
to the symmetry of the random walk in which the non-Martingale Urn models lead to an increase 
in entropy from Gaussian states. The condition also shows that universal symmetry in the macro¬ 
state is equivalent to increasing entropy. Certain models of social opinion dynamics, treated as Urn 
models, do not increase in entropy, unlike isolated mechanical systems. 


Physical applications of urn problems can be traced to 
the Ehrenfest model to describe the Second Law of Ther¬ 
modynamics [ij. However, systems such as the Ehrenfest 
model do not adequately describe the dynamics of in¬ 
teracting particle systems [Ij. In the systems that we 
introduce, the particles change urns by interacting with 
each other. Naturally, these models have a wide range 
of physical applications for various interpretations of the 
urns themselves, such as well mixed kinetic reactions 
and thermodynamics [Hl^. These models also have ap¬ 
plications to social opinion dynamics, in which the voter 
model is the only case that is a martingale. When 
the system is generalized to three urns, one can pose 
Naming Game dynamics on the complete graph 1C 


m 

in a similar fashion. Further instances of interacting par¬ 
ticle systems are the contact process, exclusion processes, 
and stochastic Ising models [3, Q • 

In addition to the class of models that describe in¬ 
teracting particle systems, we also provide their exact 
solutions. The method is an extension of the generating 
function solution of the Ehrenfest model formulated by 
Mark Kac in 1947 Q. We utilize a generating function 
method for solving the spectral problem of the Markov 
transition matrix for each model. With the explicit di- 
agonalization of the transition matrix, we can compute 
several quantities depending on the application of the 
model. In sociophysics [l3l , the expected time to consen¬ 


sus is one quantity of interest [i3,[il[iM3. We also 


provide a condition in which entropy will decrease from 
Gaussian states, which would violate the Second Law of 
Thermodynamics. Fig. [T] describes the classification of 
these models based upon solvability and relevant macro¬ 
scopic properties. 


In these models, two urns {A and B) have N balls dis¬ 
tributed between them. In a discrete time step, two balls 
are drawn randomly. The balls are redistributed between 
the urns stochastically. The redistribution probabilities 
depend on the urns from which the balls came and the 
order that they were drawn. 

The post-selection probability distributions define rate 
parameters which specify the model in the macro-state. 
Let n^(m) denote the number of balls in urn A at dis- 



FIG. 1. Classification tree for the 2-Urn problems that shows 
all relevant subclasses. Among the linear cases (271 — 272 — 
oi + 02 + /li — dz = 0 ), the martingales (qi = fh,a 2 = 
/t 2 = 71 = 72 = 0 ) are equivalent to the voter model and the 
non-martingales constitute a much larger class of models. We 
show that an entropy increase in the non-martingale cases is 
equivalent to macroscopic symmetry of the model given by 
Eqn. (I20I) . 


Crete time m. The model is characterized through the 
specification of the rate parameters, which we denote as 
{«!,02,/3i),52,71,72}- Given that the balls came from 
different urns, ai and j5i are the probabilities that ua 
increases/decreases by one respectively. If they were 
drawn from the same urn, 02 and P2 are the probabili¬ 
ties that riA increases or decreases by one respectively. 
Similarly, 71 and 72 are the probabilities that ua in¬ 
creases or decreases by two. Since these parameters cor¬ 
respond to probabilities, they are constrained as such, 
e.g., 02 +7i < 1- 

The parameters of the urn model correspond to the 
influence of people in social settings. Values of oi and 
/3i correspond to the impact a person has on another 
with the opposite opinion. Here, two opposing individu- 
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als enter a discussion and one of them changes their opin¬ 
ion as a result. The voter model assumes this and has 
parameter configuration {a, 0 , a, 0 , 0 , 0 }, where a scales 
time. The other parameters, Q! 2 ,/ 32 ) 7 i) and 72 can cor¬ 
respond to mutation and competition between individ¬ 
uals. Also, these parameters can represent push-pull 
factors to Lee’s model of migration [l 8 |, and quadratic 
transition probabilities reflect the assumptions made in 
Gravity models of migration and trade jl^, 111 . Exist¬ 
ing models with explicit parameter configurations also 
include the Moran model of genetic drift, with param¬ 
eters {1 — /ri,/r2 ,1 — M2jJ/'uO,0}, where and fj,2 are 
mutation probabilities [2l|, [2^ . We can explicitly diag¬ 
onalize this model for any N and choice of parameters 
using these techniques. These models emphasize that 
the population size, N, is not always large and thus the 
discrete analysis here is necessary. We can also solve an 
extension with 71,72 0 that is beyond the tridiagonal 

case, which the Stieltjes i nteg ral representation method 
of Karlin cannot solve [2^. l24l| . 

The parameters affect the transition probabilities of 
the urn model when ua = *, which are given to be 
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Here, we define = Pr{AnA = k\nA = i} and 
= Pr{AnA = —k\nA = i}- Notice that the parame¬ 
ter choice {1,1,1,1,0,0} exactly simplifies to the Ehrenfest 
model. Let = Pr{nA{'m) = i\. We introduce the 


finite difference operator acting on a grid function (j)i 
defined as Aki[(j)i] = cj)i+k — 4’i- We form the single step 
difference equation that describes the probability distri¬ 
bution in macro-state: 


at *'’ - at ’ = A_„|pf>7“>| + '<.<’"'1 

+ A+H[97ft7’] + a+2.[97«71 ( 5 ) 

This constitutes a pentadiagonal Markov transition ma¬ 
trix for the system. We solve for all eigenvalues and 
eigenvectors of this model by extending the procedure 
in M- For eigenvalue A and eigenvector v with com¬ 
ponents Ci, let G{x,y) = CiX^y^~'‘ be the generating 

function for the eigenvectors. We rewrite the spectral 
problem for the single step propagator given in Eqn. dSD 
as a partial differential equation for G usii^the differen¬ 
tiation and shift properties of G BHi-ial- The PDF 
for G is 


N{N - 1)(A - 1)G = 71 (a;^ - y‘^)Gyy + aix{x - y)Gxy 
+ a 2 y{x - y)Gyy - 72 ( 0 ;^ - y‘^)Gxx - I3iy{x - y)Gxy 

- I32x{x - y)Gxx- (6) 

To solve this equation, we make the change of variables 
u = x — y and H{u,y) = G{x,y). We show below that H 
has the same structure as G. That is, we define H{u, y) = 
biU^y^~^. This change of variables allows us to solve 
the system when 271 — 272 — ai -I- a 2 + /3i — /Sa =0. Un¬ 
der this restriction, the change of variables will transform 
the pentadiagonal structure of the transition matrix into 
a lower triangular matrix. Since the transformed matrix 
is lower triangular, the difference equation for bi is ex¬ 
plicit, which allows us to find both A and c^. Collecting 
coefficients in the transformed PDE for H yields 


^ _ {[(-271 -I- ai){i - 1) -I- (271 -I- a 2 ){N - i)\bi-i + 71 (A^ - i + 2)bi-2}{N -ipl) 

N{N — 1)(A — 1) + (271 -I- 272 -1-02-1- — f) -I- \{oii + a2 + Pi + P2)i{i — 1) 


(7) 


This allows us to find all eigenvalues exactly. Since 
Ci = 0 for z < 0 and i > N, we require bi — 0 for z < 0 
and i > N as well. Since Eqn. © is an explicit linear 
difference equation, every bi = 0 unless the equation is 
singular for some i = k. However, this corresponds to 
the trivial solution to the eigenvalue problem. Thus, the 
denominator of Eq. © must be zero when i = k. Solving 
for A shows that the eigenvalues are 


Afc = 1 — 


(271 -I- 272 -I- 02 + P2)k{N — k) 
iV(iV- 1) 

(oi -|- 012 -\- Pi -\- P2')k(k — 1 ) 


2N{N - 1) 


( 8 ) 


for fc = 0 ... A^. This allows bk to take any value. Values 
for bi for any i > k can be found by repeated application 
of Eq. ([7|) . Expressing H {u, y) in the original coordi- 
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nates, gives 

N N 

G(x,j/) = ^^(-ir* 

2=0 j—i 

which shows that H and G have the same form [l6| . 
Thus the spectral problem is solved for all urn models 
that satisfy 271 — 272 — ai + a2 + Pi — P2 = 0 . This 
parameter constraint holds if and only if the dynamical 
system for mean density [pA{t), psit)]"'" is linear. We 
define a linear urn model as any of the above models 
that satisfy this constraint. We conjecture that no other 
change of variables {x, y) — )> (m, v) will solve the nonlinear 
cases in this fashion, although a proof of this claim is not 
given. 

The treatment of the spectral problem by generating 
functions is equivalent to a similarity transformation of 
the transition matrix. Let T denote the transition ma¬ 
trix given by Eqn. and let v = Pw for some trans¬ 
formation matrix P. Then, the spectral problem for w 
is given by P“^TPw = Aw. The generating function 
method prescribes the matrix P so that the new matrix 
L = P-ITP is lower triangular with a bandwidth of at 
most two. The components of the transformation matri¬ 
ces that do this are determined to be 

[p]d = (-ir*Q (10) 

[p-'k. = (^)- (11) 

We use the convention that (^) = 0 when i > j, which 
suggest that P and P“^ are upper triangular. 

The spectral decomposition of the transition matrix 
can be found by this similarity transformation. We do 
this by diagonalizing the matrix L = WAW“^. Here, 
A = diag{Xo, ... , Aat) and W are the eigenvectors of L. 
The components of these eigenvectors are bi correspond¬ 
ing to eigenvalue Afc. Since 5 ^ = 0 for z < j, W is lower 
triangular. Therefore, can be found explicitly via 

forward substitution. Diagonalization of L allows us to 
explicitly diagonalize the transition matrix as 

T = (PW)A(PW)"\ (12) 

The immediate consequence of the explicit diagonal¬ 
ization of the transition matrix is the solution of the m 
step propagator. With this solution, we can find several 
valuable quantities summarized in Table HI The quantity 
dk is the initial distribution expressed in the eigenbasis. 
That is, dk are the components of d = (PW)~^a(°). 

The consensus time is the amount of scaled time (r = 
m/N) until all of the balls are in a single urn and the 
dynamics of the system halt. We assume that only one 
of the consensus points is an absorbing state and without 
loss in generality, we assume that it is when ua = N in¬ 
stead of UA = 0 . When both consensus points are absorb¬ 
ing, the linear urn model reduces to the voter model on 


bjx^y 


N-i 


( 9 ) 


TABLE I. Exact Solutions 


Quantity 

Macro-state 

probability 

Consensus 

time 


Discrete Solution 


dkp\ 


^ '[^(1 - " 
joiivfcjiv-l -I- j^ [Vfc]iV-2| 


1 d 

Local time j5[M] ~ 

k=o ~ 


Gibbs entropy 


JV 

Sim) = 


i=0 




FIG. 2. Consensus time simulation data plotted with the 
exact solution given in Table[Il For each N, the expected time 
to consensus is averaged over 1000 runs of the urn model with 
parameters {1, 1/4, 1/4, 0, 1/4, 0}. Using drift estimation 
[1(1.1^. it can be shown that the consensus time is 0(log N). 


the complete graph, which is well studied 12 , 15 , 16 , 2 ^. 
Not only can the expected time to consensus be found, 
but the moment as well 1 ^. Fig. [ 2 ] compares the 
exact solution against simulation data. 

The local time is the total amount of scaled time spent 
in each macro-state prior to the absorbing consensus. 
The sum of the local times is equal to the consensus 
time, which makes this a more detailed quantity. The 
expected local time Mi for macro-state ua = z is known 
to be E[Mi] = ^ X)m=o which we can compute ex¬ 
actly by the diagonalization [ 1 ^ . 

Next, we consider entropy defined in the sense of Gibbs 
(3^ . We also make the assumption that each micro-state 
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is equally likely for a given macro-state [3l|. When the 
probability distribution is Af{n,a'^), the entropy can be 
shown to be 5 ^ A^[log2 —2cr^ —2(^—i)^]-|-log(2-\/]Vcr)-|- 
We use this when calculating the change in entropy 
between the stationary distribution and an initial Gaus¬ 
sian distribution, M, a^). Let to be the discrete 
stationary distribution and let 7r(p; N) Ri iTiN approxi¬ 
mate TTi for large N. The following results show that the 
stationary distribution is asymptotically Gaussian whose 
mean and variance are also calculated exactly. 

Theorem: The following holds for all non-martingale 
linear urn models [271 -|- 272 -I- 02 + /32 0 ] .• 

(1) tt{p-N) =M'{Hf,aj)+ 0 (13) 

(2) E^ua] = bi (14) 

(3) VarT,{nA) = 2b2 + bi - bf (15) 

Proof: The proof of statement (1) begins by finding the 
Fokker-Plank equation for the probability density, u{p, t), 
as iV —>• 00 : 

Ut-^-^^[v{p)u] + ^^[D{p)u]. (16) 

Here, v{p) = 2p^‘^'>(p) + p^^\p) — q^^\p) — 2q^^\p), and 
D{p) = 4p(^^(/9) +p^^\p) q^^\p) + 4g(^)(p). The func¬ 

tions p^^\p) and q^^'^ip) are the continuous analogs of 
their discrete counterparts. As t —>■ 00 , M(t, p) —>■ 7r(p; N), 
and ut{p,t) —?> 0. The ODE for the stationary distribu¬ 
tion is 

0 = -^[u(p)7r(p;fV)] -h (17) 

Since we assume that the drift is linear, v{p) is a linear 
function. Furthermore, there exists po such that v{po) = 
0. Therefore, we write v{p) = v\(p — po). We make 
the change of variables p ^ f defined as p = po -\- 5f. 
We will choose d = o(l) so that the ODE has non-trivial 
balance. Also, we let 7r(p; N) = 7ro(p; A^)-|-d7ri(p; A^)-|-... 
be an asymptotic expansion of the stationary probability 
density. Making these substitutions into Eqn. m yields 

-..|[fMe;iv)l + 5^;Jl»oK;iv)l + o(^)=o, 

(18) 

The coefficients Dq and vi depend only of the choice of 
parameters {oi, 02 ,/3i,/ 32 , 7 i) 72 }- For the leading order 
terms to balance, choose S = l/\/]V. As N —!■ 00 , the 
leading order terms give an ODE for 7ro(f;N). The so¬ 
lution of this ODE is a Gaussian function centered at 
^ = 0. To characterize the mean and variance, we prove 
statements (2) and (3). 

The proof of (2) follows by considering the generating 
function G(x, y) that corresponds to the eigenvalue A = 


1 . This is defined by G{x,y) = ■ Note that 

G(l, 1 ) = 1 for normalization and ETr[nA] = Gx{l, 1 ). In 
terms of H{u,y) = J2ibiU^y^~\ we have that iL( 0 ,l) = 
1 and Ga;(l, 1 ) = iL„( 0 , 1 ). This implies that, 60 = 1 and 
iL„( 0 , 1 ) = bi. Therefore, E^[nA] = &i- Since bi = 0 for 
j < 0 , we can use Eqn. o to find bi exactly. The proof 
of (3) is demonstrated in a similar fashion. □ 

The values of bi and 62 depend only on the choice of 
parameters and N, which allow us to exactly characterize 
the stationary distribution. When 62 and bi are combined 
to give VarTr{nA), the result is 0{N). Thus, the variance 
for the density is ctj = 0{1/N). Since the stationary 
distribution is also Gaussian, the change in entropy is 
AS log((7//cro) - ‘ 2 Naj + 2 N[a'^ + {po - 1 / 2 )^ - (pj - 
1 / 2 )^]. As A —>■ 00, this implies that the entropy of the 
system will decrease when 

M/(l-M/) <Mo(l-Mo)- ctq. ( 19 ) 

A significant consequence of Eqn. dUl) is that unless 
Pf{l — pf) achieves its maximum value, there will always 
exist an initial condition, (po, (Tq), that will cause entropy 
to decrease with time for large N. Thus, for an entropy 
increase as A —>• 00, we require Pf = bi/N = 1 / 2 . 

We show that the condition given in Eqn. m for an 
increase in entropy is equivalent to a form of symmetry in 
the model. Let Ui, U 2 denote the urns that the first and 
second balls are selected respectively and [/“ denotes the 
urn that is opposite to U. We define a macroscopically 
symmetric urn model when 

E[AnA\Ui, U 2 ] = EIAubWI Utf] ( 20 ) 

for all permutations of Ui,U 2 - The following result re¬ 
lates entropy to this form of symmetry. 

Theorem: If the urn model is linear and non¬ 

martingale, then Eqn. dsni) is necessary and sufficient 
for an increase in entropy from Gaussian states. 

Proof: If the system is macroscopically symmetric, 
then 271 — 272 -I- 02 — /32 = 0 and oi = / 3 i. These con¬ 
straints together imply that the system has linear drift. 
Furthermore, using Eqn 0, we have that Pf = 1 / 2 , 
which is sufficient to show that entropy increases from 
Gaussian initial states by Eqn. CH). To show the con¬ 
verse, an entropy increase requires Pf = 1 / 2 , which im¬ 
plies 271 — 272 + a2 — P2 = 0 . Using linearity, we have 
oi = fi, which is sufficient to show macroscopic symme¬ 
try. □ 

If the microscopic behavior of the system is invariant 
under an urn permutation, then oi = / 3 i, 02 = /32j 7i = 
72. If microscopic symmetry holds, then macroscopic 
symmetry holds, but the converse is not necessarily true. 
A counterexample to this is to consider 71 = 1 / 2 , /32 = 1 , 
and all other parameters are zero. 
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The methods above may be useful in solving more so¬ 
phisticated problems that involve more than two urns. 
For example, the multi-state voter model [s^, the Nam¬ 
ing Game [3 [si, and genetic drift with migration 
are multi-urn models with quadratic transition probabili¬ 
ties such as the above. The above techniques are capable 
of analyzing parts of these models to a greater extent and 
can provide more detailed solutions than existing meth¬ 
ods. 
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